Iris authentication device, iris authentication method and recording medium

ABSTRACT

The disclosure is inputting a first image obtained by capturing an object of authentication moving in a specific direction; inputting a second image at least for one eye obtained by capturing a right eye or a left eye of the object; determining whether the second image is of the left eye or the right eye of the object, based on information including the first image, and outputting a determination result associated with the second image as left/right information; comparing characteristic information relevant to the left/right information, the characteristic information being acquired from a memory that stores the characteristic information of a right eye and a left eye pertaining to object to be authenticated, with characteristic information associated with the left/right information, and calculating a verification score; and authenticating the object captured in the first image and the second image, based on the verification score, and outputting an authentication result.

This application is a National Stage Entry of PCT/JP2018/036033 filed onSep. 27, 2018, the contents of all of which are incorporated herein byreference, in their entirety.

TECHNICAL FIELD

The example embodiments relates to an iris authentication device and thelike for authenticating an object.

BACKGROUND ART

The personal authentication based on the individual difference of aliving body (biometrics-based authentication) has a lower risk ofleakage and theft than a password or the like prepared by a user. Forthis reason, there are increasing examples of introducing the personalauthentication based on the individual difference of a living body forthe purpose of specifying an individual and confirming the right or forthe purpose of security protection. As a personal authenticationtechnique based on the individual difference of a living body,techniques using a fingerprint, a vein, a face, an iris, a voice and thelike as biometric information are known. Among these techniques, irisauthentication has high authentication accuracy. The reason for this isthat the iris pattern is more complicated than the pattern of thefingerprint, and the iris pattern certainly differs from person toperson. Once the iris pattern is completed, the pattern does not changeor deteriorate thereafter. Unlike the fingerprint, the iris pattern canbe recognized without contact, and forgery is difficult. Additionally,the iris pattern is different between the right eye and the left eyeeven of the same person.

However, when iris authentication is performed, since the iris patternis different between the right eye and the left eye as described above,it is necessary to identify between the right and left eyes. For thepurpose of this identification, for example, there is a technique ofidentifying between the right and left eyes using the shape of the innercorner of the eye near the iris (see PTL 1). In addition, PTL 2discloses a technique related to an iris authentication device.

CITATION LIST Patent Literature

[PTL 1] JP 2005-227933 A

[PTL 2] WO 2009/016846 A

SUMMARY Technical Problem

However, it is not always possible to identify between the right andleft eyes based on the inner corner of the eye, which is a part of theface. For example, the inner corner of the eye sometimes cannot becaptured accurately in a case where, for example, a dark shadow isproduced on the face, the face is irradiated with strong light, theshape of the inner corner of the eye varies depending on the facialexpression, or the inner corner of the eye is hidden by hair or glasseswhen the face of a user who is an object of authentication is captured.In order to capture the inner corner of the eye in detail from adistance, a telephoto camera with a high magnification and an imageanalyzing device with a high degree of accuracy are required, whichincreases the cost.

The disclosure has been made in view of the above disadvantages, and itis an object of the disclosure to provide an iris authentication deviceand the like that perform iris authentication with a high degree ofaccuracy by reliably identifying between the right and left eyes.

Solution to Problem

In view of the above disadvantages, an iris authentication device as afirst aspect of the disclosure includes:

a first image input means for inputting a first image obtained bycapturing an object of authentication moving in a specific direction;

a second image input means for inputting a second image at least for oneeye obtained by capturing a right eye or a left eye of the object;

a determination means for determining whether the second image is of theleft eye or the right eye of the object, based on information includingthe first image, and outputting a determination result associated withthe second image as left/right information;

a memory means for storing characteristic information on irises of aright eye and a left eye pertaining to one or more objects to beauthenticated;

a score calculation means for comparing characteristic information on aniris calculated from the second image associated with the left/rightinformation, with one or more sets of the characteristic informationrelevant to the left/right information stored in the memory means, andcalculating a verification score; and

an authentication means for authenticating the object captured in thefirst image and the second image, based on the calculated verificationscore, and outputting an authentication result.

An iris authentication method as a second aspect of the disclosureincludes:

inputting a first image obtained by capturing an object ofauthentication moving in a specific direction;

inputting a second image at least for one eye obtained by capturing aright eye or a left eye of the object;

determining whether the second image is of the left eye or the right eyeof the object, based on information including the first image, andoutputting a determination result associated with the second image asleft/right information;

comparing one or more sets of characteristic information relevant to theleft/right information, the characteristic information being acquiredfrom a memory means that stores the characteristic information on irisesof a right eye and a left eye pertaining to one or more objects to beauthenticated, with characteristic information on an iris calculatedfrom the second image associated with the left/right information, andcalculating a verification score; and

authenticating the object captured in the first image and the secondimage, based on the calculated verification score, and outputting anauthentication result.

An iris authentication program as a third aspect of the disclosurecauses a computer to implement:

inputting a first image obtained by capturing an object ofauthentication moving in a specific direction;

inputting a second image at least for one eye obtained by capturing aright eye or a left eye of the object;

determining whether the second image is of the left eye or the right eyeof the object, based on information including the first image, andoutputting a determination result associated with the second image asleft/right information;

comparing one or more sets of characteristic information relevant to theleft/right information, the characteristic information being acquiredfrom a memory means that stores the characteristic information on irisesof a right eye and a left eye pertaining to one or more objects to beauthenticated, with characteristic information on an iris calculatedfrom the second image associated with the left/right information, andcalculating a verification score; and

authenticating the object captured in the first image and the secondimage, based on the calculated verification score, and outputting anauthentication result.

The iris authentication program may be stored in a storage medium.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 is a diagram illustrating a configuration example of an irisauthentication device according to a first example embodiment of thedisclosure.

FIG. 2 is a diagram illustrating an example of an image of an objectuser moving in a specific direction.

FIG. 3 is a diagram illustrating an example of a first image and asecond image acquired from the image of the object user.

FIG. 4 is a diagram illustrating an example of the second image to whichleft/right information are associated.

FIG. 5 is a flowchart illustrating the operation of the irisauthentication device according to the first example embodiment of thedisclosure.

FIG. 6 is a diagram illustrating a configuration example of an irisauthentication device according to a second example embodiment of thedisclosure.

FIG. 7 is a diagram illustrating an example of the configuration of datastored in a memory.

FIG. 8 is a flowchart illustrating the operation of the irisauthentication device according to the second example embodiment of thedisclosure.

FIG. 9 is a diagram illustrating a configuration example of an irisauthentication device according to a third example embodiment of thedisclosure.

FIG. 10 is a flowchart illustrating the operation of the irisauthentication device according to the third example embodiment of thedisclosure.

FIG. 11 is a configuration diagram of an information processing deviceusable in the first to third example embodiments.

EXAMPLE EMBODIMENT

Hereinafter, several example embodiments will be described in detailwith reference to the drawings. In the following drawings, the same orsimilar parts are denoted by the same or similar reference signs.However, the drawings schematically depict the configuration in theexample embodiments. Additionally, the example embodiments to bedescribed below are merely examples, and can be modified as appropriateto essentially the same extent.

First Example Embodiment

Information for biometric authentication includes a plurality of piecesof information such as an ultrasound graph, an image of a living body,or voice data. In the following description, images (specifically, irisimages) are mainly used for explanation as an example, but this is notintended to limit each example embodiments.

The object of biometric authentication is mainly a living body, andincludes a person (user), an animal, and the like. The object includesother than the living body, such as a mannequin. When irisauthentication is performed, the right and left eyes (includingartificial eyes to be misused for spoofing) of the object of the irisauthentication are authenticated. In the following description of eachexample embodiment, the object of authentication is also referred to as“object user”.

Iris Authentication Device

As illustrated in FIG. 1 , an iris authentication device 100 includes afirst image input unit 11, a second image input unit 12, a determinationunit 13, a score calculation unit 14, a memory 15, and an authenticationunit 16.

The first image input unit 11 and the second image input unit 12 areconnected to a camera 10. The camera 10 is a camera for capturing anobject to be authenticated. There may be one or a plurality of cameras10. The camera 10 captures a user moving in a specific direction. Movingin a specific direction means that, for example, in the case ofwalk-through authentication (that refers to performing biometricauthentication while an object user of authentication is moving withoutstopping), the user walks from the entrance gate to the exit gate of theauthentication execution area. The user moving in the specific directionis captured by the camera 10 as an image as illustrated in FIG. 2 . Thecamera 10 is fixed at a position where an image as illustrated in FIG. 2can be captured (a wall, a gate, and the like). In an image captured bythe camera 10, image data of a region including the whole body of theuser is input to the first image input unit 11 as a first image, andimage data of regions including the right and left eyes of the user andits peripheries are input to the second image input unit 12 as secondimages. This process of selecting the image region may be performed bythe first image input unit 11 and the second image input unit 12 thathave received an image from the camera 10. The first image input unit 11and the second image input unit 12 may receive the input of images ofthe selected image regions after the camera 10 performs the aboveprocess.

The first image input unit 11 receives an input of the first image (seeFIG. 3 ) obtained by capturing a region including the whole body of theuser moving in the specific direction, from the camera 10. The firstimage may be a face image of the user.

The second image input unit 12 receives an input of the second image(see FIG. 3 ) obtained by capturing at least one of the right eye andthe left eye of the user moving in the specific direction, from thecamera 10. The second image input unit 12 preferably receives inputs ofimages for both eyes. However, when the camera 10 cannot acquire theimage of one eye (for example, one eye cannot be captured due to bangsover the one eye or the reflection of glasses), an image of the othereye that can be captured is captured. In FIG. 3 , while, as an example,the camera 10 uses the left and right eye regions in the whole bodyimage (first image) of the user as an object being captured, as thesecond image, the left and right eye regions may be enlarged by atelephoto lens and captured.

The determination unit 13 determines whether the second image is of theleft eye or the right eye of the user, based on information includingthe first image, and outputs left/right information indicating thedetermination result, in association with the second image (see FIG. 4). As will be described later, the determination unit 13 outputs theimage of the iris part as illustrated in FIG. 4 . In the exampleembodiment, for example, one of the following two approaches is used fordetermining between the right and left eyes. As the first approach, thedetermination unit 13 applies a predetermined template for detecting thecontour of the face and the positional relationship between both eyesand the like to the region of the user's face in the first image toperform a matching process, and determines whether the second image isof the left eye or the right eye of the user. In order to detect thepositional relationship between both eyes, the face of the user needs toface the front with respect to the camera 10. By setting the camera 10at a position where the user moving toward a predetermined travelingdirection can be captured, the user facing the front with respect to thecamera 10 can be inevitably placed as an object of the determination. Asthe second approach, the determination unit 13 compares pixels in theregions of the right eye and the left eye of the user in the first imagewith pixels in the regions of the right eye or the left eye of the userin the second image, and determines whether the second image is relevantto the left eye or the right eye of the user. In this case, asillustrated in FIG. 3 , the determination unit 13 extracts pixels in theregion of each of the right eye and the left eye of the user in thefirst image, which is the image of the whole body, and compares theextracted pixels with pixels in the region of the eye captured in thesecond image to determine whether the eye captured in the second imageis the left or right eye, according to the degree of similarity betweenthe compared pixels. For the comparison between pixels, a contourtracking algorithm using a chain code, a principal component analysismethod, a three-dimensional phase-only correlation method, or the likemay be used. The approach of determination between the right and lefteyes is not limited to the above approaches.

The first image and the second image may be captured at the same timingusing two cameras 10. At this time, a telephoto camera capable ofcapturing at a high magnification may be employed as the camera forcapturing the second image. Furthermore, the first image and the secondimage may be captured at different timings using the same camera 10. Atthis time, it is preferable that the camera 10 be capable of quicklyswitching the magnification of the telephoto function for capturing thefirst image and the second image of the subject.

The memory 15 stores characteristic information on the iris of the righteye and characteristic information on the iris of the left eye for aplurality of users. The characteristic information on the iris is, forexample, an iris code (see the characteristic information in FIG. 7 )generated based on the Daugman algorithm.

The score calculation unit 14 calculates the characteristic informationon the iris from the second image associated with the left/rightinformation (see FIG. 4 ). A case where the iris code is used as thecharacteristic information on the iris will be described as an example.The score calculation unit 14 specifies the boundary line of the irisfrom the image of the iris received from the determination unit 13, andextracts the iris part. Furthermore, the score calculation unit 14applies a two-dimensional Gabor filter to information on the extractediris part to encode the iris pattern, and generates the iris code. Theiris code is, for example, a 2048-bit digital encoded code.

Here, the second image associated with the left/right information refersto an iris image designated to be the right eye and then tagged as“right eye” by the determination unit 13, or an iris image designated tobe the left eye and then tagged as “left eye” by the determination unit13 (see FIG. 4 ). An iris code tagged as any one of the right and lefteyes may also be employed as the above second image.

The score calculation unit 14 compares the calculated characteristicinformation with the characteristic information of a plurality of usersrelated to the left/right information, which is stored in the memory 15.Specifically, the score calculation unit 14 makes comparison with thecharacteristic information on only the right eye stored in the memory 15in the case of the iris image tagged as the right eye, and makescomparison with the characteristic information on only the left eyestored in the memory 15 in the case of the iris image tagged as the lefteye. The score calculation unit 14 obtains a verification score as aresult of comparison. The verification score represents a value obtainedas a result of calculating the number of bits different between the iriscode of the object user and the iris code registered in the memory 15(Hamming distance calculation). The score calculation unit 14 outputsthe verification score to the authentication unit 16.

The authentication unit 16 receives the verification score from thescore calculation unit, and authenticates that the user captured in thefirst image and the second image is a registered user (legitimate user)when the verification score is equal to or more than a predeterminedthreshold value, while authenticating that the user captured in thefirst image and the second image is not a registered user when theverification score is equal to or less than a predetermined thresholdvalue. The authentication unit 16 then outputs the authentication resultto an external display unit 20. The display unit 20 is a liquid crystaldisplay or the like, and is assumed to be capable of displaying theauthentication result in such a way that the object user or anadministrator of the authentication execution area can browse theauthentication result. In addition, the authentication result may bemade known by voice notification by a speaker or a buzzer, lamplighting, or the like.

Operation of Iris Authentication Device

The operation of the iris authentication device 100 according to thefirst example embodiment will be described with reference to theflowchart in FIG. 5 . It is assumed that the memory 15 stores in advancethe characteristic information on the irises of the right eye and theleft eye pertaining to a plurality of users that can be placed as anobject of authentication.

In step S101, the first image input unit 11 receives an input of thefirst image obtained by capturing an object user of authenticationmoving in a specific direction. The second image input unit 12 receivesan input of the second image at least for one eye obtained by capturingthe right eye or the left eye of the object user.

In step S102, it is determined whether the second image is of the lefteye or the right eye of the object user, based on information includingthe first image, and the left/right information indicating thedetermination result is output in association with the second image.

In step S103, the score calculation unit 14 calculates the verificationscore obtained by comparing the characteristic information on the iriscalculated from the second image associated with the left/rightinformation, with one or more sets of the characteristic informationrelevant to the left/right information stored in the memory 15.

In step S104, the authentication unit 16 authenticates the user capturedin the first image and the second image, based on the calculatedverification score, and outputs the authentication result.

As described above, the operation of the iris authentication device 100ends.

Effects of First Example Embodiment

According to the first example embodiment, iris authentication can beperformed by reliably identifying between the right and left eyes. Thereason for this is that the determination unit 13 determines whether thesecond image is of the left eye or the right eye of the user, based oninformation including the first image, and outputs the determinationresult associated with the second image as the left/right information.

Second Example Embodiment

While the weights of the authentication of the right and left eyes arethe same in the first example embodiment, since the characteristics ofthe left and right irises are different even for the same person, thereare eyes that are easy to identify and eyes that are difficult toidentify. Since the time taken for the authentication process is shortand the identification accuracy is high for the eyes easy to identify,authentication can be performed with higher accuracy in a shorter timeby performing the authentication process using the eye easy to identifyregardless of any of the right and left eyes. In a second exampleembodiment, an iris authentication device and the like that perform anauthentication process by weighting the eye easy to identify will bedescribed.

Iris Authentication Device

As illustrated in FIG. 6 , an iris authentication device 200 includes afirst image input unit 11, a second image input unit 12, a determinationunit 13, a score calculation unit 14 a, a memory 15 a, and anauthentication unit 16 a. The first image input unit 11 and the secondimage input unit 12 are connected to an external camera 10. Theauthentication unit 16 a is connected to an external display unit 20.

The memory 15 a stores characteristic information and a reliabilityscore of the right eye and characteristic information and a reliabilityscore of the left eye of each user to be placed as an object ofauthentication for each identifiable identifier (ID) associated with theuser. The reliability is a value representing the ease of identificationbetween the object user and other users, and the reliability score isobtained by representing the value of the reliability as 0 to 100%. Anexample of the calculation method for the reliability score will bementioned. Assuming that each of the IDs of registered users stored in asecond memory 17 a is denoted by i (i={1, 2, 3, . . . , N}; N denotesthe total number of registered users), the characteristic information(characteristic vector) in the iris image of the right eye of eachregistered user is denoted by X_(right)(i), and the characteristicinformation (characteristic vector) in the iris image of the right eyeof the current object user (a person desired to be verified) is denotedby Y_(right), a correlation between X_(right)(i) and Y_(right) (forexample, normalized cross-correlation) is calculated for all registeredusers i.

After the calculation, the ratio (=highest correlation value/secondhighest correlation value) of the largest correlation value (that is, acorrelation value between the correct persons (when the object user isfound as a registered user)) to the second largest correlation value (acorrelation value between the correct person and a registered user whois the other person with the highest correlation value) is calculated,and the calculated value is employed as a reliability S_(right).Similarly, a similar process is performed for the left eye, and thecalculated value is employed as a reliability S_(left). Thesereliabilities S_(right) and S_(left) are normalized and converted intovalues from 0% to 100% to obtain reliability scores (for example, 20%for the left eye and 80% for the right eye). Although there are variousapproaches for normalizing the reliability, for example, the reliabilityis calculated by the reliability score (%)=100×(S−1)/(M−1) (where 1≤S≤M;S represents either S_(right) or S_(left), and M represents the maximumvalue of the reliability, the maximum value is preset by a designer orthe like, and the reliability in the case of M<S is assumed as 100). Thecalculation method for the reliability score is not limited to theabove. The higher the value of the reliability score is, the easier thecharacteristic information of the object user is identified (the objectuser has a rare iris code), compared with the characteristic informationof other users. For example, in the case of the user ID “1”, since thereliability score of the right eye is 80% and the reliability score ofthe left eye is 20%, the iris of the right eye of this user ischaracteristic, which indicates that there are relatively no users whohave resembling characteristic information. On the other hand, the irisof the left eye of this user is not very characteristic, which indicatesthat there are many users who have resembling characteristicinformation. In such a case, since it is more efficient to use the righteye for the authentication process, it can be said that it is desirableto perform the authentication process using the second image of theright eye even when the second images of both eyes have beensuccessfully captured. On the other hand, when only the second image ofthe left eye has been successfully captured due to some circumstances,even if the verification score during authentication is low, it can beinferred that this is because the reliability score of the left eye islow, and in this case, the iris authentication device 200 may requestthe user to retake the iris image. Specifically, the iris authenticationdevice 200 requests this user to move again from the entrance gate tothe exit gate for authentication, via the display unit 20 or the like.When an eye with a higher reliability score is hidden by hair or thelike, the authentication unit 16 a may present, on the display unit 20,text or the like requesting cooperation from the user in such a way thatthe eye with a higher reliability score can be clearly captured by thecamera 10.

The score calculation unit 14 a calculates a value obtained by joiningthe reliability score with the verification score, in addition to theoperation of the score calculation unit 14 illustrated in FIG. 1 . Thescore calculation unit 14 a calculates the verification score obtainedby comparing the characteristic information on the iris calculated fromthe second image associated with the left/right information, with one ormore sets of the characteristic information relevant to the left/rightinformation stored in the memory 15 a. Furthermore, the scorecalculation unit 14 a specifies the object user based on theverification score, and acquires the reliability score relevant to theobject user from the memory 15 a to calculate a score in which thereliability score is reflected on the calculated verification score. Forexample, in the case of a user having the ID in FIG. 7 of “1”, thereliability score of the right eye is 80% and the reliability score ofthe left eye is 20%. Therefore, when the verification scores of thesecond images of both eyes have been calculated, the score calculationunit 14 a weights the verification score of the right eye with thereliability score of the right eye and the verification score of theleft eye with the reliability score of the left eye. At this time, thescore calculation unit 14 a may increase the priority of the eye havinga higher reliability to weight only the verification score of the righteye with the reliability score of the right eye. This makes it possibleto obtain a score with higher reliability. The weighting refers toobtaining a calculation result by, for example, multiplying or addingboth of the scores, or substituting both of the scores into apredetermined mathematical formula. The authentication unit 16 aperforms the authentication process using the weighted score.

The operations of the other units are similar to the operations in thefirst example embodiment.

Operation of Iris Authentication Device

The operation of the iris authentication device 200 according to thesecond example embodiment will be described with reference to theflowchart in FIG. 8 . It is assumed that the memory 15 a stores inadvance the characteristic information and the reliability scores (seeFIG. 7 ) of the irises of the right eye and the left eye pertaining to aplurality of users that can be placed as an object of authentication.

Steps S201 to S203 are similar to steps S101 to S103 in FIG. 5 .

In step S204, the score calculation unit 14 a specifies the object userin the memory 15 a based on the verification score calculated in stepS203, acquires the reliability score relevant to the object user fromthe memory 15 a, and weights the calculated verification score with thereliability score (hereinafter referred to as a weighted verificationscore). At this time, the score calculation unit 14 a may put thepriority on an eye having a higher reliability to weight theverification score of this eye having the higher priority with thereliability score of this eye.

In step S205, the authentication unit 16 a authenticates the object usercaptured in the first image and the second image, based on the weightedscore. Specifically, the authentication unit 16 a authenticates that theuser captured in the first image and the second image is a registereduser (legitimate user) when the weighted verification score is equal toor more than a predetermined threshold value, while authenticating thatthe user captured in the first image and the second image is not aregistered user when the weighted verification score is equal to or lessthan a predetermined threshold value, and outputs the authenticationresult to an external display device or the like (not illustrated).

As described above, the operation of the iris authentication device 200ends.

Effects of Second Example Embodiment

According to the second example embodiment, the authentication processcan be performed with higher accuracy in addition to the effects of thefirst example embodiment. The reason for this is that the scorecalculation unit 14 a specifies the object user in the memory 15 a basedon the calculated verification score, and acquires the reliability scorerelevant to the object user from the memory 15 a, to weight thecalculated verification score with the reliability score. Furthermore,the reason for this is that the score calculation unit 14 a puts thepriority on an eye having a higher reliability to weight theverification score of this eye having the higher priority with thereliability score of this eye.

Third Example Embodiment

While only the iris authentication using the second image is performedin the first and second example embodiments, other biometricauthentication (human shape authentication, gait authentication, faceauthentication, or the like) may be performed using the first image, andmulti-modal authentication combining the results of two types ofauthentication may be performed. This makes it possible to furtherimprove the accuracy of authentication. In the third example embodiment,an iris authentication device and the like in which other biometricauthentication is combined will be described. The human shapeauthentication refers to authentication performed based on the physicalcharacteristics of the object person of authentication (for example, theheight, body width, limb lengths, facial contour, and the like, or acombination of these characteristics).

Iris Authentication Device

As illustrated in FIG. 9 , an iris authentication device 300 includes afirst image input unit 11, a second image input unit 12, a determinationunit 13, a score calculation unit 14 a, a memory 15 a, an authenticationunit 16 b, a second score calculation unit 17, a second memory 18, and ascore integration unit 19. The first image input unit 11 and the secondimage input unit 12 are connected to an external camera 10. Theauthentication unit 16 b is connected to an external display unit 20.

The second memory 18 stores information (characteristic information onhuman shape, gait, face, and the like) used during authentication ofother biometric authentication (human shape authentication, gaitauthentication, face authentication, or the like) using the first image.

The second score calculation unit 17 calculates characteristicinformation of a user to be placed as an object of authentication, fromthe first image as a second verification score for other biometricauthentication.

What type of biometric authentication is to be used by the second scorecalculation unit 17 may be initially set or the user may be allowed tomake this setting. For example, when the first image is a static imageor a moving image obtained by capturing the whole body of the user, thesecond score calculation unit 17 performs human shape authenticationusing the static image or gait authentication using the moving image,and calculates the second verification score. When the first image is animage obtained by capturing the face of the user, the second scorecalculation unit 17 performs face authentication using the first image,and calculates the second verification score.

The score integration unit 19 integrates the verification score outputfrom the score calculation unit 14 a (or the weighted verificationscore) with the second verification score output from the second scorecalculation unit 17, and outputs the result of integration as anintegrated score to the authentication unit 16 b. In the integrationprocess, the verification score and the second verification score aremultiplied, added or substituted into a predetermined mathematicalformula to calculate the integrated score.

The authentication unit 16 b performs the authentication process usingthe integrated score.

The operations of the other units are similar to the operations in thefirst and second example embodiments.

Operation of Iris Authentication Device

The operation of the iris authentication device 300 according to thethird example embodiment will be described with reference to theflowchart in FIG. 10 . The memory 15 a stores in advance thecharacteristic information on the irises of the right eye and the lefteye pertaining to a plurality of users that can be placed as an objectof authentication. Furthermore, the reliability scores (see FIG. 7 ) maybe stored. The second memory 18 stores in advance the characteristicinformation on the body pertaining to a plurality of users that can beplaced as an object of authentication.

Steps S301 to S304 are similar to steps S201 to S204 in FIG. 8 .

In step S305, the second score calculation unit 17 performs biometricauthentication (human shape authentication, gait authentication, faceauthentication, or the like) other than iris authentication using thefirst image in which the body image of the user is captured, calculatesthe characteristic information on the body of the user included in thefirst image, compares the calculated characteristic information with thecharacteristic information stored in the second memory 18, and outputsthe comparison result as the second verification score to the scoreintegration unit 19.

In step S306, the score integration unit 19 calculates the integratedscore obtained by joining the second verification score output by thesecond score calculation unit 17 with the verification score (or theweighted verification score) output by the score calculation unit 14 a.The score integration unit 19 outputs the calculated integrated score tothe authentication unit 16 b.

In step S307, the authentication unit 16 b authenticates the usercaptured in the first image and the second image, based on thecalculated integrated score, and outputs the authentication result.Specifically, the authentication unit 16 b authenticates that the usercaptured in the first image and the second image is a registered user(legitimate user) when the integrated score is equal to or more than apredetermined threshold value, while authenticating that the usercaptured in the first image and the second image is not a registereduser when the integrated score is equal to or less than a predeterminedthreshold value, and outputs the authentication result to the externaldisplay device 20 or the like.

As described above, the operation of the iris authentication device 300ends.

Effects of Third Example Embodiment

According to the third example embodiment, the iris authenticationdevice 300 having higher authentication accuracy than the irisauthentication devices described in the first and second exampleembodiments can be provided. The reason for this is that the secondscore calculation unit 17 calculates the characteristic information fromthe body image of the object user of authentication included in thefirst image, and outputs the second verification score, while the scoreintegration unit 19 calculates the integrated score in which the secondverification score is reflected on the verification score (or theweighted verification score), and the authentication unit 16 b performsthe authentication process based on this integrated score.

The example embodiments may be used in combination with each other.

Information Processing Device

In each of the above-described example embodiments, some or all ofmultiple constituent elements of the iris authentication devicesillustrated in FIGS. 1, 6, 9 , and other drawings can be achieved usingany combination of an information processing device 500 and a program asillustrated in FIG. 11 , for example. The information processing device500 includes, as an example, the following constituents.

Central processing unit (CPU) 501

Read only memory (ROM) 502

Random access memory (RAM) 503

Storage device 505 that stores program 504 and other data

Drive device 507 that performs reading and writing on recording medium506

Communication interface 508 connected to communication network 509

Input/output interface 510 that inputs and outputs data

Bus 511 that connects between respective constituent elements

Each constituent element of the iris authentication device in eachexample embodiment of the application is achieved by the CPU 501acquiring and executing the program 504 that enables the functions ofthese constituent elements. The program 504 that enables the function ofeach constituent element of the iris authentication device is stored inadvance, for example, in the storage device 505 or the RAM 503, and isread out by the CPU 501 as necessary. The program 504 may be supplied tothe CPU 501 via the communication network 509, or may be stored inadvance in the recording medium 506 in such a way as to be supplied tothe CPU 501 by the drive device 507 that has read out the storedprogram.

The method of achieving each device has various modifications. Forexample, the iris authentication device may be achieved by anycombinations of information processing devices and programs that areseparate from each other for each constituent element. A plurality ofconstituent elements included in the iris authentication device may beachieved by any combination of one information processing device 500 andone program.

Some or all of multiple constituent elements of the iris authenticationdevice are achieved by other general-purpose or dedicated circuitry,processor, or the like, or a combination thereof. These constituentelements may be constituted by a single chip or a plurality of chipsconnected via a bus.

Some or all of multiple constituent elements of the iris authenticationdevice may be achieved by a combination of the circuitry or the likedescribed above and a program.

In a case where some or all of multiple constituent elements of the irisauthentication device are achieved by a plurality of informationprocessing devices, pieces of circuitry, or the like, the plurality ofinformation processing devices, pieces of circuitry, or the like may becentrally arranged or dispersedly arranged. For example, the informationprocessing devices, pieces of circuitry, or the like may be achieved asa form in which the devices or pieces of circuitry or the like areconnected with each other via a communication network, such as a clientand server system or a cloud computing system.

The whole or part of the example embodiments disclosed above can bedescribed as, but not limited to, the following supplementary notes.

Supplementary Note 1

An iris authentication device comprising:

a first image input means for inputting a first image obtained bycapturing an object of authentication moving in a specific direction;

a second image input means for inputting a second image at least for oneeye obtained by capturing a right eye or a left eye of the object;

a determination means for determining whether the second image is of theleft eye or the right eye of the object, based on information includingthe first image, and outputting a determination result associated withthe second image as left/right information;

a memory means for storing characteristic information on irises of aright eye and a left eye pertaining to one or more objects to beauthenticated;

a score calculation means for comparing characteristic information on aniris calculated from the second image associated with the left/rightinformation, with one or more sets of the characteristic informationrelevant to the left/right information stored in the memory means, andcalculating a verification score; and

an authentication means for authenticating the object captured in thefirst image and the second image, based on the calculated verificationscore, and outputting an authentication result.

Supplementary Note 2

The iris authentication device according to supplementary note 1,wherein

the memory means stores reliability scores of the right eye and the lefteye pertaining to the objects to be authenticated, and

the score calculation means specifies the object based on theverification score, acquires one of the reliability scores relevant tothe object from the memory means, and calculates a weighted verificationscore obtained by weighting the verification score with the one of thereliability scores.

Supplementary Note 3

The iris authentication device according to supplementary note 1 or 2,wherein

the score calculation means calculates the weighted verification scoreby putting priority on an eye having a higher value indicating one ofthe reliability scores.

Supplementary Note 4

The iris authentication device according to any one of supplementarynotes 1 to 3, further comprising:

a second memory means for storing characteristic information calculatedfrom body images of one or more objects to be authenticated;

a second score calculation means for calculating characteristicinformation from a body image of the object included in the first imageacquired from the first image input means, comparing the calculatedcharacteristic information with the characteristic information stored inthe second memory means, and outputting a comparison result as a secondverification score; and

a score integration means for calculating an integrated score in whichthe second verification score output by the second score calculationmeans is reflected on the verification score or the weightedverification score output by the score calculation means, wherein

the authentication means authenticates the object captured in the firstimage and the second image, based on the verification score, theweighted verification score, or the integrated score, and outputs anauthentication result.

Supplementary Note 5

The iris authentication device according to supplementary note 4,wherein

the first image is a static image or a moving image obtained bycapturing a whole body of the object, and the second score calculationmeans calculates the characteristic information on the body image byexecuting human shape authentication using the static image or a gaitauthentication using the moving image.

Supplementary Note 6

The iris authentication device according to supplementary note 4,wherein

the first image is an image obtained by capturing a face of the object,and the second score calculation means calculates the characteristicinformation on the body image by executing face authentication using thefirst image.

Supplementary Note 7

The iris authentication device according to supplementary note 1,wherein

the determination means applies a predetermined template to a region ofa face of the object in the first image, and determines whether the twoimages are relevant to the left eye or the right eye of the object.

Supplementary Note 8

The iris authentication device according to supplementary note 1,wherein

the determination means compares pixels in regions of the right eye andthe left eye of the object in the first image, with a pixel in a regionof the right eye or the left eye of the object in the second image, anddetermines whether the two images are relevant to the left eye or theright eye of the object.

Supplementary Note 9

An iris authentication method comprising:

inputting a first image obtained by capturing an object ofauthentication moving in a specific direction;

inputting a second image at least for one eye obtained by capturing aright eye or a left eye of the object;

determining whether the second image is of the left eye or the right eyeof the object, based on information including the first image, andoutputting a determination result associated with the second image asleft/right information;

comparing one or more sets of characteristic information relevant to theleft/right information, the characteristic information being acquiredfrom a memory means that stores the characteristic information on irisesof a right eye and a left eye pertaining to one or more objects to beauthenticated, with characteristic information on an iris calculatedfrom the second image associated with the left/right information, andcalculating a verification score; and

authenticating the object captured in the first image and the secondimage, based on the calculated verification score, and outputting anauthentication result.

Supplementary Note 10

The iris authentication method according to supplementary note 9,wherein

the memory means stores reliability scores of the right eye and the lefteye pertaining to the objects to be authenticated, and

the calculating the verification score specifies the object based on theverification score, acquires one of the reliability scores relevant tothe object from the memory means, and calculates a weighted verificationscore obtained by weighting the verification score with the one of thereliability scores.

Supplementary Note 11

The iris authentication method according to supplementary note 9 or 10,wherein

the calculating the verification score calculates the weightedverification score by putting priority on an eye having a higher valueindicating one of the reliability scores.

Supplementary Note 12

The iris authentication method according to any one of supplementarynotes 9 to 11, further comprising:

calculating characteristic information from a body image of the objectincluded in the first image acquired from the first image input means,comparing the calculated characteristic information with characteristicinformation stored in a second memory means that stores thecharacteristic information calculated from body images of one or moreobjects to be authenticated, and outputting a comparison result as asecond verification score; and

calculating an integrated score in which the second verification scoreis reflected on the verification score or the weighted verificationscore, during the calculating the verification score, wherein

the authenticating the object and the outputting the authenticationresult include authenticating the object captured in the first image andthe second image, based on the verification score, the weightedverification score, or the integrated score, and outputting anauthentication result.

Supplementary Note 13

The iris authentication device according to supplementary note 12,wherein

the first image is a static image or a moving image obtained bycapturing a whole body of the object, and the outputting the comparisonresult as the second verification score includes calculating thecharacteristic information on the body image by executing human shapeauthentication using the static image or a gait authentication using themoving image.

Supplementary Note 14

The iris authentication device according to supplementary note 12,wherein

the first image is an image obtained by capturing a face of the object,and the outputting the comparison result as the second verificationscore includes calculating the characteristic information on the bodyimage by executing face authentication using the first image.

Supplementary Note 15

The iris authentication device according to supplementary note 9,wherein

the outputting the determination result associated with the second imageas the left/right information includes applying a predetermined templateto a region of a face of the object in the first image, and determiningwhether the two images are relevant to the left eye or the right eye ofthe object.

Supplementary Note 16

The iris authentication device according to supplementary note 9,wherein

the outputting the determination result associated with the second imageas the left/right information includes comparing pixels in regions ofthe right eye and the left eye of the object in the first image, with apixel in a region of the right eye or the left eye of the object in thesecond image, and determining whether the two images are relevant to theleft eye or the right eye of the object.

Supplementary Note 17

A storage medium storing an iris authentication program for causing acomputer to implement:

inputting a first image obtained by capturing an object ofauthentication moving in a specific direction;

inputting a second image at least for one eye obtained by capturing aright eye or a left eye of the object;

determining whether the second image is of the left eye or the right eyeof the object, based on information including the first image, andoutputting a determination result associated with the second image asleft/right information;

comparing one or more sets of characteristic information relevant to theleft/right information, the characteristic information being acquiredfrom a memory means that stores the characteristic information on irisesof a right eye and a left eye pertaining to one or more objects to beauthenticated, with characteristic information on an iris calculatedfrom the second image associated with the left/right information, andcalculating a verification score; and

authenticating the object captured in the first image and the secondimage, based on the calculated verification score, and outputting anauthentication result.

Supplementary Note 18

The storage medium according to supplementary note 17, wherein

the memory means stores reliability scores of the right eye and the lefteye pertaining to the objects to be authenticated, and

the calculating the verification score specifies the object based on theverification score, acquires one of the reliability scores relevant tothe object from the memory means, and calculates a weighted verificationscore obtained by weighting the verification score with the one of thereliability scores.

Supplementary Note 19

The storage medium according to supplementary note 17 or 18, wherein

the calculating the verification score calculates the weightedverification score by putting priority on an eye having a higher valueindicating one of the reliability scores.

Supplementary Note 20

The iris authentication method according to any one of supplementarynotes 17 to 19, further comprising:

calculating characteristic information from a body image of the objectincluded in the first image acquired from the first image input means,comparing the calculated characteristic information with characteristicinformation stored in a second memory means that stores thecharacteristic information calculated from body images of one or moreobjects to be authenticated, and outputting a comparison result as asecond verification score; and

calculating an integrated score in which the second verification scoreis reflected on the verification score or the weighted verificationscore, during the calculating the verification score, wherein

the authenticating the object and the outputting the authenticationresult include authenticating the object captured in the first image andthe second image, based on the verification score, the weightedverification score, or the integrated score, and outputting anauthentication result.

Supplementary Note 21

The iris authentication device according to supplementary note 20,wherein

the first image is a static image or a moving image obtained bycapturing a whole body of the object, and the outputting the comparisonresult as the second verification score includes calculating thecharacteristic information on the body image by executing human shapeauthentication using the static image or a gait authentication using themoving image.

Supplementary Note 22

The iris authentication device according to supplementary note 20,wherein

the first image is an image obtained by capturing a face of the object,and the outputting the comparison result as the second verificationscore includes calculating the characteristic information on the bodyimage by executing face authentication using the first image.

Supplementary Note 23

The iris authentication device according to supplementary note 17,wherein

the outputting the determination result associated with the second imageas the left/right information includes applying a predetermined templateto a region of a face of the object in the first image, and determiningwhether the two images are relevant to the left eye or the right eye ofthe object.

Supplementary Note 24

The iris authentication device according to supplementary note 17,wherein

the outputting the determination result associated with the second imageas the left/right information includes comparing pixels in regions ofthe right eye and the left eye of the object in the first image, with apixel in a region of the right eye or the left eye of the object in thesecond image, and determining whether the two images are relevant to theleft eye or the right eye of the object.

While the application has been particularly shown and described withreference to exemplary embodiments thereof, the application is notlimited to these embodiments. It will be understood by those of ordinaryskill in the art that various changes in form and details may be madetherein without departing from the spirit and scope of the exampleembodiments as defined by the claims.

REFERENCE SIGNS LIST

-   10 camera-   11 first image input unit-   12 second image input unit-   13 determination unit-   14 score calculation unit-   14 a score calculation unit-   15 memory-   15 a memory-   16 authentication unit-   16 a authentication unit-   16 b authentication unit-   17 second score calculation unit-   18 second memory-   19 score integration unit-   20 display unit-   100 iris authentication device-   200 iris authentication device-   300 iris authentication device-   501 CPU-   503 RAM-   504 program-   505 storage device-   506 recording medium-   507 drive device-   508 communication interface-   509 communication network-   510 input/output interface-   511 bus-   507 drive device-   508 communication interface-   509 communication network-   510 input/output interface-   511 bus

The invention claimed is:
 1. An iris authentication device comprisingone or more memories storing instructions and one or more processorsconfigured to execute the instructions to: input a first image obtainedby capturing an object of authentication moving in a specific direction;input a second image at least for one eye obtained by capturing a righteye or a left eye of the object; determine whether the second image isof the left eye or the right eye of the object, based on informationincluding the first image, and output a determination result associatedwith the second image as left/right information; compare characteristicinformation on an iris calculated from the second image associated withthe left/right information, with one or more sets of the characteristicinformation relevant to the left/right information stored in a memorythat stores the characteristic information on irises of a right eye anda left eye pertaining to one or more objects to be authenticated andreliability scores of the right eye and the left eye pertaining to theobjects to be authenticated, calculate a verification score, specify theobject based on the verification score, acquire one of the reliabilityscores relevant to the object from the memory, and calculate a weightedverification score obtained by weighting the verification score with theone of the reliability scores; and authenticate the object captured inthe first image and the second image, based on the weighted verificationscore, and output an authentication result.
 2. The iris authenticationdevice according to claim 1, wherein the one or more processors areconfigured to execute the instructions to calculate the weightedverification score by putting priority on an eye having a higher valueindicating the one of the reliability scores.
 3. The iris authenticationdevice according to claim 1, wherein the one or more processors areconfigured to execute the instructions to: calculate secondcharacteristic information from a body image of the object included inthe first image, compare the calculated second characteristicinformation with the second characteristic information stored in asecond memory that stores the second characteristic informationcalculated from body images of the one or more objects to beauthenticated, and output a second comparison result as a thirdverification score; calculate an integrated score in which the thirdverification score is reflected on the verification score or theweighted verification score; and authenticate the object captured in thefirst image and the second image, based on the verification score, theweighted verification score, or the integrated score, and output theauthentication result.
 4. The iris authentication device according toclaim 3, wherein the first image is a static image or a moving imageobtained by capturing a whole body of the object, and the secondcharacteristic information on the body image is calculated by executinghuman shape authentication using the static image or a gaitauthentication using the moving image.
 5. The iris authentication deviceaccording to claim 3, wherein the first image is an image obtained bycapturing a face of the object, and wherein the one or more processorsare configured to execute the instructions to calculate the secondcharacteristic information on the body image by executing faceauthentication using the first image.
 6. The iris authentication deviceaccording to claim 1, wherein the one or more processors are configuredto execute the instructions to apply a predetermined template to aregion of a face of the object in the first image, and determine whetherthe second image is relevant to the left eye or the right eye of theobject.
 7. The iris authentication device according to claim 1, whereinthe one or more processors are configured to execute the instructions tocompare pixels in regions of the right eye and the left eye of theobject in the first image, with a pixel in a region of the right eye orthe left eye of the object in the second image, and determine whetherthe second image is relevant to the left eye or the right eye of theobject.
 8. An iris authentication method comprising: inputting a firstimage obtained by capturing an object of authentication moving in aspecific direction; inputting a second image at least for one eyeobtained by capturing a right eye or a left eye of the object;determining whether the second image is of the left eye or the right eyeof the object, based on information including the first image, andoutputting a determination result associated with the second image asleft/right information; comparing one or more sets of characteristicinformation relevant to the left/right information, the characteristicinformation being acquired from a memory that stores the characteristicinformation on irises of a right eye and a left eye pertaining to one ormore objects to be authenticated and reliability scores of the right eyeand the left eye pertaining to the objects to be authenticated, withcharacteristic information on an iris calculated from the second imageassociated with the left/right information, calculating a verificationscore, specifying the object based on the verification score, acquiringone of the reliability scores relevant to the object from the memory,and calculating a weighted verification score obtained by weighting theverification score with the one of the reliability scores; andauthenticating the object captured in the first image and the secondimage, based on the weighted verification score, and outputting anauthentication result.
 9. A non-transitory recording medium recordedwith an iris authentication program for causing a computer to implement:inputting a first image obtained by capturing an object ofauthentication moving in a specific direction; inputting a second imageat least for one eye obtained by capturing a right eye or a left eye ofthe object; determining whether the second image is of the left eye orthe right eye of the object, based on information including the firstimage, and outputting a determination result associated with the secondimage as left/right information; comparing one or more sets ofcharacteristic information relevant to the left/right information, thecharacteristic information being acquired from a memory that stores thecharacteristic information on irises of a right eye and a left eyepertaining to one or more objects to be authenticated and reliabilityscores of the right eye and the left eye pertaining to the objects to beauthenticated, with characteristic information on an iris calculatedfrom the second image associated with the left/right information,calculating a verification score, specifying the object based on theverification score, acquiring one of the reliability scores relevant tothe object from the memory, and calculating a weighted verificationscore obtained by weighting the verification score with the one of thereliability scores; and authenticating the object captured in the firstimage and the second image, based on the weighted verification score,and outputting an authentication result.